Information Retrieval, Information Structure, and Information Agents

This paper presents a customizable architecture for software agents that capture and access information in large, heterogeneous, distributed electronic repositories. The key idea is to exploit underlying structure at various levels of granularity to build high-level indices with task-speciic interpretations. Information agents construct such indices and are conngured as a network of reusable modules called structure detectors and segmenters. We illustrate our architecture with the design and implementation of smart information lters in two contexts: retrieving stock market data from Internet newsgroups, and retrieving technical reports from Internet ftp sites.